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Concept mapping typically refers to the graphic 
representation of concepts and their interrelationships. In this 
instance, concept mapping is used as a means for assessing an 
individual's conceptual understanding" of a. curricular topic. In a 
series of studies with teacher trainees, emphasis was on determining 
whether concept maps have regular features which are quantifiable and 
vhich change as a function of instruction. Differences were found on 
number of items (dif f erentiation ) on pre and post ma^ps ^or topics 
^ which were the focus of course instruction l>ut not for topics for 
which there was not instruction. The internal contents of maps were 
highly idiosyncratic and, although in the absence of instruction, 
there were not significant changes in differentiation or overall 
complexity, there were changes in the specific content included. 
Nevertheless, the maps appeared to be excellent diagnostic dj^vices 
for determining individuals*^ conceptions regarding topics such as 

teaching, ^ "classroom management , " "documentation of children's 
gains." Differences were also found on differentiation scores and on 
the number of subordinate levels portrayed between groups of teacher 
trainees with differing amounts of education for the topic 
"teaching." Years of experience for inservice teachers, however, were 
not related to scores derived from. maps. (Author) 
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ABSTRACT 



Concept mapping typically refers to the graphic representation of 
concepts and their interrelationships. In this instance, concept 
mapping is used as a means for assessing an individual 'e conceptual 
understanding of a curricular topic. In a series of studies with 
teacher trainees, emphasis jwas on determining whether ^oneept-maps have " 
regular features which are quantifiable and which chknge as a function 
of instruction. Differences were found on number of items (differen- 
tiation) on pre and post maps for topics which were the focus of course 
instruction but not for topics for which there was not instruction. The 
internal contents of maps were highly idiosyncratic and, although in the 
absence of instruction, there were not significant changes in differen- 
tiation or overall complexity, there were changes in the specific con- 



TSitTS^Tuded. Nevertheless, the maps appeared to be excellent diagnos- 
tic devices for determining individuals' conceptions regarding topics 
such as "teaching," "classroom management," "documentation of children's 
gains." 

Differences were also found on differentiation^ scores and on the 
number of subordinate levels portrayed between groups of teacher trainees 
with differing amounts of education for the topic "teaching." Years of 
experience for inservice teachers, however, were not related to scores 
derived from maps. 
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The term concept mapping has appeared in recent profess ioiial lit- 
erature with related but differing applications. It typically refers 
to the technique of graphically representing concept? and their Inter- 
relationships and has been suggested as a means for Increasing reading 
comprehension (Hanf, 19tl; Rauch and Ellenworth, 1980), as a study 
strategy for college students (Relgeluth, 1979) and as a strategy for 
-^aly;ciuB ccSncepTual'sFructure oF a subject of Interest e.g., program 
evaluation (Gowln and Green), and course content (Stewart et al., 1979; 
Dlekhoff and Wekhoff, 1982). 

For the purposes of the studies herein reported, concept mapping 
has been defined as a process by which Individuals may illustrate their 
respective understandings of a given content area by letting their 
thoughts flow freely and hierarchially organizing in chart form these 
free associations around the content label and indicating with connecting 
lines, interrelationships between ideas. Superordinate-subordinate 
relationships, interrelationships among subordinate concepts, a? well as 
content diversity, are graphically presented. In our work, we are 
primarily focusing on the usefulness of concept mapping for assessing 
Individuals' current degree of concept organization and concept dif- 
ferentiation around given topics. Novak (1981) and associates are 
pursuing a similar research agenda with the expectation that concept 
mapping can serve as a powerful tool for ascertaining what students 
know in a new area and for assessing student achievement. This type of 
investigation is within the genre of what Sternberg (1981) describes 
as a 'icogniClve-contents" approach to psychometric testing. This Is 
based on the idea that a locus of difference between more and less able 



people relevant to a given task is the extent to which they have 
meaningfully organized information in long-term memory in a way that 
makes it readily available. By obtaining and contrasting concept maps 
on selected topics from persons with differing experiences, we are at- 
tempting to determine the viability of this approach for individual 
assessment'. , 



Several aspects of concept mapping are of potential interest. The 
specific content and positioning of that content on an individual's map 
provide useful information on thinking relative to that topic. We are 
' also interested in the following types of quantitative measures— (a) 
the number of discrete entries Included on an individual's concept map 
(b) the number of subordinate levels employed and (c) the number of 
distinct item streams (superordinate concepts) and their interrelation- 
ships. Theoretical support for examining differentiation and conceptual 
hierarchies comes from sevefal sources. 
Theoretical Background 

Lewin (1975) described development as increasing differentiation 

in skills, emotions, needs and knowledge as evidenced in more varied 

« 

behaviors; According to Lewin, "...the hierarchial organization , of the 
life space increases with age. Such an increase can be observed with- 
in the inner psychological regions and in the relation of the psycho- 
logical environment to the inner personal regions" (1951, p. 110). 
Werner (1978) similarly suggested that thinking processes follow cer- 
tain developmental regularities involving increased differentiation and 
hierarchial organization. He distir?guished betwee^ two types of dif- 
ferentiation~one a vertical differentiation which involves a filling 



ERIC 



out and one a horizontal differentiation which involves a reorganizing. 

c 

He clalined, "Wherever development occurs, it procee4s from a state of 
relative lack of differentiation to a state of increased differentiation 
articulation and hierarchic integration" (1978, p. 86). 

Many others, including Ausubel (1963, 1978), also argue that 
leaming as well as deyej^o^ne^ Q^y^^^^^^^j^ of pro- 

gressive differentiation and integrative reconciliation. Building on 
Ausubel -s distinction,- rote leaming is defined by Novak as new infor- 
mation "arbitrarily stored in a cognitive structure of .. .associated 
with weakly differentiated concepts at low levels of abstractness and 
inclus iveness" (1977, p. 113). Meaningful leaming, on the other hand, 
is said to occur when new information is subsumed into a larger struc- 
ture which relates it to other concepts. Ausubel 's central pedagogic 
advice is "find out what the learner knows and teach him or her 
accord|.ngly" (1978, p. 378). The learner's concept nap may provide an 
efficient graphic representation of what he/she knows about a concept 
area so that effective teaching can proceed. 

As Novak (1977) points out, standardized achievement or intelli- 
gence measure^ are inadequate for telling about "the specific conceptual ' 
hierarchies an individual possesses ... (or) the extent of differentiation 
of Concepts in these hierarchies" (p. 114). What is needed is a way 
of determining the nature and cdit>lexity of thds semantic encoding by 
which individuals represent meaning in memory. Traditional item sampling 
methods do not reveal what the individual is capable of reconstructing 
from memory without prompts regarding a subject of interest. It has 
been well-established that recall memory is different from recognition 
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memory (Klntsch, 1974^ p. 94); recall requires "the internal recording 
of experiences upon which recognition is based, plus... the organization 
of these experiences into meiaory nets." It is the format of these 
"memory nets" and their contents that the instructor of Ausubel's per- 
suasion seeks, since effectiveness of instruction is thought to be de- 

" ._— *-%f — 

pendent on whether new learning tasks may be predictably adapted to 

existing concepts in the learner ^s cognitive structure to which they are 
relatable (Ausubel, 1963, p. 89). 

Ausubel (1978) proposes that "with increased age, concepts tend 

(1) to Consist of higher-order abstractions, (2) to exhibit more precis- 

f 

ion as well as differentiation,; (3) to be acquired more through con- 
cept assimilation than through concept formation; (4) to be accompanied 
by awareness of the conceptualizing operations^ involved" (p. 87). 

We make the assumption that relevant dimensions regarding a ^nce^t 
ar^a can be brought into awareness to be graphically portrayed tn a way 
which reflects the organization and complexity of ftmctional meni?ry 
structures. Though it has been suggested by Novak (1979; 1981) aijid 
Stewart et al., (1979) that mapping could be used to examine cognitive 
structure variables and as diagnostic instruments in planning for 
instruction, little research has investigated these claims. The 
research that has been reported has focused only on scientific disci- 
plines. 

In a series of studies we are investigating — 

1. ^ whether concept maps have regular features from which reliable 
measures of dif ferentiatibti or structural organization may 
be derived. 
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2. whether persons of varying degrees of training and/or exper- 
ience prpduce qualitatively or q^ntltatlyely different con- 
cept naps. 

3. whether concept maps reflect Increased knowledge resulting 
from Instructional Interventions. 

4. whether scores derived from concept maps reflect competence 
as assessed via other indices relating to the same concept ^ 
area. 

Study 1 

The intent of Study 1 was to determine whether changss in students' 
knowledge and understanding of a topic are reflected in concept mapping 
before and after the study of that topic, and if so, to analyze the 
nature of these changes. 
Subjects 

The subjects of this initial study were five graduate students. 
Master's degree candidates, enrolled in a summer session seminar dn 
documentation of young children's learning taught by one of the investi- 
gators. The students' respective specialities were library science, 
special education, home economics education, developmental psychology 
and elementary education. Two had classroom teaching experience; the 
others had not. The sample in this study and in the three subsequent 
studies were predominantly female. To our knowledge none had previously 
done concept mapping. 
Procedure 

On the first day of the seminar the students were shown a complex 
copcept map prepared by the instructor on the topic of sailing . They 
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were then directed to f ortray their concepts of "documentation" as the 
. t^erm would be applied to "the means for documenting the extent to which 

children change over time as either a function of development or 
, learning." Blank sheets, 12" x 20", were provided and ample class time 

was available; completion of the maps was accomplished within appro- 
ximately 20 minutes by all students. Although the maps were collected 
by the Instructor, they were not further discussed with the students. 

On the last day of the six-week seminar foi' their final, examina- 
tion, the students were ^provided with their initial concept map, a 
blank 12" x 20" sheet and another sheet on which the following was 
written: 

NOTE 

Examine the concept map you completed on 
June 30th to refresh your memory of the 
way you thought about documentation of 
children's learning and development at 
that point. Then, through writing, 
listing, outlining and/or some kind of 
graphic portrayal, show how you are now 
thinking about documentation of children's 
development and learning. 

All five students elected to produce a second concept map rather taking 

the other options of writing, listing or outlining. 

Results 

The concept maps, pre and post, produced by the five students were 
qualitatively analyzed. Overall, the final concept mkps were markedly ^ 
clearer than the same individual ' s pre-maps in regard to hierarchial 
structure and interrelationships. Examples of a pre-map and a post- 
map of one of the students (designated as Student A below) are shown 
in Figures 1 and 2. 
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Insert Figures 1 and 2 about here 



There were wide individual differences on both pre-maps ai\d post- 
maps. Exposure to the same materials and experiences during the semi- 
nar lead to less homogeneity in the ways individuals represented their 
concepts than was anticipated. The individual differences are quali- 
tatively analyzed in the following case descriptions. 

Student A initially produced a very sparse pre-map. On one line 
the word tests was written which then branched into three items — skill , 
written and oral. Two of these "s|:reams'^ (lines leading outward from 
the central content label — documentation ) seemed quite irrelevant to 
the topic. At the end of the course, this students' post-map was far 
more differentiated. As an example, one stream had five branches and 
two of these had even further levels of sub-branching... All were highly 
relevant. There was no doubt that this students' conceptualisation of 
this topic, as evidenced by the contrast between pre-map and post-map, 
had become more differentiated and complex as a result of her summer 
experiences. 

""Student B, in contrast to Student A, entered the seminar with a 
rich set of concepts on documentation drawn from prior coursework. The 
initial map appeared very complex. Much of it, however, was concerned 
with documentation for purposes of determining program effects as they 
persisted across time. For example, one stream was labeled correlates 
to later society development which branched into Items of future em- 
ployment , continuation of education , criminal conviction , etc. While 

10 
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the concept aap seemed to reflect the student 's awareness of the context 
and purposes of documentation only one stream of twelve items was con- 
cerned with alternatives for the actual documentation process. 

The post concept map drawn by Student B was quite different from 
the pre. One stream labeled "reasons for documentation" had ten items 
at the next level. One of thesfe items was "evaluation of program 
effectiveness," the topic which had been almost the entire focus of the 
pro-map. In Werner's <^l/9.78)termlnology , there was both horizontal and 
vertical differentiation. 

Student C, a practicing teacher, produced a pre-map which reflected 
the practical tasks of classroom testing and the school's traditional 
testing program. One item stre^un was achievement testing with names of 
specific standardized achievement tests as its branches. Another was 
labeled methods with items of written, oral, auditory , visual . An ' 
item stream called materials lead into a listing of such items as papers 
(tests), pencils , pens, tape recorders , tape^. head phone . The post- 
map was qualitatively at a higher level of abstractness, reflecting 
considerable learning. One item stream was entitled type of instrument 
with sub-streams of norm-referenced, criterion-referenced , observation . 
Another stream was entitled purposes of instruments . The post-map 
showed much more sophistication about documentation than the pre-map. 

Student D's initial concept map appeared sparse but, unlike some 
of the other pre-maps, included the same genre of concepts the instructor 
had scheduled for inclusion in the course of study. The post-map 
reflected increased differentiation developed through the course ex- 
perience. The post-map was, however, also somewhat differently or- 
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ganlzed than the pre-map. In the pre-oap the five item streans were 
not easy to interpret in a meaningful way. They were labeled hypo- 
theses, testing measures . research studies , testing of persons , ob- 
servation. In the post-map the streams were developed according to 
who x^Duld be doing documentation. There was one for physicians .or 
psychologists, one for parents, one for teachers. The overall post- 
map was representative of this student's interest in becoming involved 
as a psychometrist within a social service agency. 

Student E's pre and post maps were very different from the other 
students . One reason was that the student seemed to interpret the task 
as requiring flow-charting. The maps, both pre and post, represented 
more process emphasis than was the case with the other students. This 
student's pre-map was complex but highly convoluted and unclear. The 
post-map had only two streams of items leading from the central concept 
but a clearer decision process sequence. In other classroom activities 
as well it seemed that this student's focus was more on clarifying and 
linking the wide array of facts and ideas he appeared to have acquired 
at some prior point so as to have access to them to make them more us- 
able. Although there was evidence of increased differentiation (added 
items) and the deletion of some pre-ltems which might hest be des- 
cribed as "noise," the most striking changes were in clarity of organi- 
zation and intra-map connections. 

The five sets of maps, presented in pairs to two judges, were 

)' ' . . 

quickly identified by hoth as to which was pre and which post. The 

clearer organization and increased vertical dif ferentiaiton of the post 
mips were not difficult to discern. 
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Discussion 

The concept map goes beyond assessing the' student's knowledge at 
the recognition level; It demands recall and, further, the placement of 
that which Is recalled within a meaningful graphic representatatlon. 
\Jhat Is placed on the concept map' appears to directly reflect the 
student's, frame of reference, and, thus, may serve well as a diagnostic 
device or as a metisure of concept acquisition resulting from Instruc- 
tion. For each student In the seminar, for example. It was possible to 
draw Inferences about the nature and extent of changes from examining 
the pre and post maps. Positive changes were obvious in each case yet 
the mapping products were quite unique to the particular individual. 

study II 

The intent of Study II was to investigate whether differences in 
educational level and professional experience would be reflected in 
quantitative measures derived from respondents' concept maps. In 
addition, we addressed the question of whether instructors' rankings 
of students' performance in education course would be related to the 
scores derived from concept maps on the general topic of "teaching." 
Subjects 

Fifty-six students enrolled in education courses comprised the 
sample. They were at three different levels— novice undergraduates in 
an introductory course on study of teaching (N-18) , advanced under- 
gradftates in a social studies 'methods course (N-18) , and inservice ex- 
perienced teachers in a graduate level course on thinking skills (N-20) . 
Subjects at all three levels represented a variety of majors or sub- 
specialities. The novice undergraduate grdlxp consisted primarily of 
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freshmen or sophomores taking their first education course. The social 
studies methods group were elementary education majors all of whom had 
completed a number of education courses with related elementary school- 
based experiences. The in-service teachers were ±n such areas as el- 
ementary, secondary, art, music. Their mean years of teaching expe- 
rience was approximately 11, (standard deviation 6.6), and the range 
was from one to 25 years. All subjects participated in the concept 
mapping activity as part of their regular course involvement. 
Procedure 

In eacli of the three courses the instructor (In one instance one 
of the investigators was the course instructor) gave a brief chalk- 
board illustration of the process of concept mapping for the concept 
"math" and then introduced the activity by distributing 8^1 by 11 inch 
sheets with the word "teaching" encircled in the middle of the page and 
with the following written •directions: 

NOTE 

Please complete the concept map below 
to illustrate your current cohception 
of the components bf teaching. Let 
your thoughts flow freely, pursuing 
details under ^ general category, until 
you lose interest and a new general 
category suggests itself. You may 
indicate connections between ideas 
with connecting lines. 

The activity was initiated toward the end of the class period. There 

was no time limit although it was suggested that the activity might 

take five to ten minutes. All students easily completed their "maps" 

within that time range. 
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Methods of Scoring 

Number of Items . Following Levin's (1951) def :«,nltlon that "the 
degree of differentiation of a whole can be defined as the number of 
Its cells (p. 119), a differentiation score was obtained for each 
Individual's cognitive map by simply counting the number of separate 
Items (discrete words or phrases) clustered around the concept of 
"teaching" regardless of placement In relation to the other Items. 
Thus, In Figure 3, the number of Items was determined by count to be 
40 and this count constituted the score. Reliability between two In- 
dependent scorers was very high (Peaeon r«.99). 



Insert Figure 3 about here 



Number of Levels . The number of levels on the contept map were 
also counted In an attempt to obtain Information about hlerarchlal 
organization. Levels were defined as the number of subsumed categorlel 
In any of the Item hierarchies as portrayed by lines drawn outward 
from the stimulus word. Each level was counted whether or not there 
was multiple branching at any juncture. Only very obviously redundant 
or parallel Items were not given credit In the scoring. Credit was 
given for each entry graphically portrayed as a new level whether or 
not the entry seemed logical to the scorer. In the example In Figure 
4 the score for number of levels was four. The two Independent scorers 
were found to have a reliability level of .80 as^ determined by Pearson 
cortelatlon. 

«. 

Number of Item Streams . The third score derived from each map was 

18 



Figure -3 

Example of Student's Map on "Teaching" 
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Directions: Please complete the cognitive nap below to illustrate your 
current conception of the components of teaching. Let your thoughts 
flow freely, pursuing details under a general categorj'. until you lose 
" • interest and a new general category suggests Itself. Tou mar indicate 
■ connections between- ideas with connecting lines. * 
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a simple count of item streams. Each line drawn out from the central 
concept word was counted us an item stream if it lead to one or more 
words or phrases. In Figure 4 there are seven item streams. Indepen- 
dent scorers had nearly perfect agreement on this count. 

The course instructors were asked to rank-order the students in 
their respective clases on the basis of their course performance. 
Results 

The means, standard deviations and ranges for number of items, 
number of levels, and number of streams are presented in Table I for 
the three. groups, along with F's on the differences between groups. 

Insert Table I about here 

Significant differences were found between the three groups on 
the number of items included in concept maps; F (2,53)-l4.72 p^OOOl, ' 
Duncan's ihiltiple Range Test determined that the experienced teacher 
group had a 'significantly higher number of items than either of the 
undergraduate groups and that the advanced- undergraduates were signi- 
,.f leant ly higher than the novice group. 

Signifcant differences were also found between the three groups on 
number of levels included in concept maps; F (2,53)«3.88, p<..03. The 
Duncan Multiple Range test found significant differences between ex- 
perienced teachers and the undergraduate groups but not between two 

\ 

undergraduate groups. There were not, however, significant differences 
between, groups on the number of Item streams. 
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Table 1 

Suinnary Statistics: Study II 



Novice UG 
(N-18) 



Advanced 
UG 

(N-18) 



Experienced 

Teachers 

(N-20) 



F(2,53) 



Number of items 
Mean 
S.D. 
Range 

Number of levels 
Mean 
S.D. 
Range 

Number of item 
streams 

^an 

S.D. 

Range 



21.72 
5.98 
7-30 

2.89 
.58 

2-4 



5.11 
2.44 
1-10 



31.28 
10.38 
9-53 

3.17 
.86 
2-5 



5.61 
2.38 
3-11 



41.70 
15.19 
13-70 

3.70 
1.17 
2-6 



5.5 
2.5 
2-11 



14.72 

p < .0001 



3.88 
P < .03 



.23 
n.s. 
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The Pearson correlation between the dimensions of concept mapping 
under consideration — number of items and number of levels was .34 
(p<,009); the correlation between number of items and number of streams 
was .32 (p.^.Ol); the correlation between number of levels and number ^ 
of streams was '-.18(n.s.) . 

Relationships analyzed with Spearman rho correlations between in- 
structor ranking of students on overall course performance and the 
students' scores for number of items, number of levels, number of 
streams were not found to be significant for any of the three groups. 
Nor were significant relationships determined via Pearson correlates 
between number of years of teaching within the inservlce graduate group 
and the three types of scores derived from the concept naps: number of 
items (r-.33, n.s.), number of levels (r-.02, n.s.), number of item 
streams (r-.OO, n.s.). 
Discussion * 

According to the findings of Study II, groups with differing 
amounts of relevant educational exposure were significantly different 
in two of the scores derived from concept maps for the global topic- 
"teaching": number of items and number of levels. These'^diff erences 
would seem to reflect the increasing differentiation of concepts and 
the overall hi^rarctiial complexity gained as a function* of individual 
•histories. While it is possible that such differences are simply a 
function of maturation and are accrued with increasing age, this seems 
unlikely. More years of experience within the experienced teacher 
group appears not to have necessarily resulted in more differentiated 

m 

or hie^archially more complex concept maps. The nature of specific 
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experiences In Interaction with per8onologl<:al variables would seem inore 
llkaly to be explanatory of individual differences in concept mapping 
than maturation, or longevity of experiences per se.' 

,There was not a relationship for any of the groups between in- 
structor ranking and the concept mapping scores. The topic "teaching" 
was a global one which may not necessarily correspond to the students' 
mastery, or lack thereof, of specific concepts introduced within the 
courses. This comparison cannot be construed as adequately answering 
the question of whether scores derived from concept maps reflect com- 
petence as assessed by other indices. 

Inspection of individual protocols revealed great Individual 
variation, even within groups, both in the overall categories included 
on concept mapa and in specific item contents. While there was some 
evidence of recent course content effects, this was less than might be 
expected and the variation within as well > as across groups was far more 
striking than the similarities. The differences in overall scores be- 
tween individuals seemed. to be due to ability (or inclination) to id- 
entify and elaborate personally idiosyncratic "schemas." The students 
did not produce maps whichr reflected a publicly-shared and learned frame- 
work. Similar to one's instructor or one's peers. If the maps obtained 
in this study are, as conjectured, direct reflections of students' con- 
ceptual structures and semantic memory schemas, one is greatly struck by 
their variabillfcy and idiosyncratic nature. 

Study III 

Study III addressed two major questions: (1) To what extent do 
•tttdcnta' concepts of a general concept area, as assessed on a concept 
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map, remain constant across time? and (2) To what extent does instruc- 
tional intervention alter students' quantitative scores on concept maps 
for a content area which is the focus cff instruction? 
Subjects 

Subjects were undergraduate students from two sections on an in- 
troductory education course. Both sections were taught by the same in- 
structor. 
Procedure 

During a class session, students were shown two examples of concept 
maps by^ne or the other of the two investigators and the process of 
concept mapping was explained. The examples were highly differentiated 
ones, projected from transparencies prepared in advance &n topics of 

"cooking" and "cabin ii\ptruction." Directions, identical to those used ' 

( . , * 

in Study if were read and 8h x 11" sheets on >^ich directions were 
inAuded were distributed. Approximately half of the students in each 
of the two sections were randomly assigned to complete a concept map 
on "teaching" and the other half were asked to complete a concept map 
on "classroom management." The students were told that their performance 
on the maps would not be shared with their instructor and would not 
affect their grades. Students in both classes took as much time as 
they wanted; many continued for as long as twenty miautes. 

The curriculum focus in both sections during the following ^hree 
weeks was on classroom management. At the end of that period, each 
student was again asked to prepare a concept map on the same topic to 
which they had been previously assigned — either "teaching" or "class- 
room management." In const rast to the first study, they were not given 
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their first map to use as a reference. Students were again told that 
the' maps would not be used in their course evaluation by their instructor. 

. Only students who were in attendance on both occasions, thus pro- 
duclng both a pre and a post map were inclbded in the study. This 
resulted in 1^ students who had >rdduced "classroom management" mapB 
and 13 who had produced "teaching" maps. ^ 
Scoring . 

Maps were scored according to the procedures described for Study 
II. ' 

Results ' ' . • 

Means, standard deviations and ranges for number of items, levjels 
and streams are presented in Table 3 along with t;he results of paii^ed 



Insert Table 2 about here * 



comparisons of pre-post change scores. The studex\ts who mapped "class- 
room mangement" had significant gains on total number of items (t^2.88, 
p< .01) and approach significance on gains for number of levels and 
streams. ^*or those who prepared maps on "teaching," there were signi- 
ficant decreases on number of streams (t«-3.59, p<.004) and a near 
significant decrease oil number of items. 

Correlations between individuals* pre and post maps on "teaching" 
were .73(p<.004) for items, .21 (N.S.) for level. and .75(p<.003) for 
streams. 

Further examination of the pre and post maps of individuals lead to 
the following cybservations: « 
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Table 2 
Summary Statistics: Study m 





Topic: 

Classroom Management 
—1...—^ (N-12) 


Topic: 
. Teaching 
.(N-13) 


Pre Post 


Pre Post 


Number of items " 




Means ' 41^58 ^ 57.66 ' 


45,30 . 38.77 




8.55 . 22.52 
22-59 * 29-110 

> 2.88(p,<.02) ■ 



16.46 14.32 
25-79 19-70 
-2.08(p<.06) 




4.67 
1.37 
3-8 



5.50 
.2.19' 
3-10 
97(p<.07) 



6.38 5.15 
1.85 1.63 
4-11 3-9* 

-3. 59 (p<. 004) 
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.For the students whose maps were done on the global topic of 
"teaching", there were many changes, pre to post, in the superordinate 

. concepts used. Although each individual's post map had greater 
Similarity to that individual's pre-map than to the maps prepared by 
other students, there were also a large number of shifts. Nearly all 
of the students used "new" concepts for at least half of their post- 
map superordinate concepts. Only 30Z of the terms which appeared as 
superordinate concepts on poet-maps had been tiaed by that same individual 
in any portion of the pre-map. 

Students who prepared their maps on "classroom management" were 
somewhat more constant in the use of concepts. Approximately 40Z of 
the superordinate concepts appearing in pre-maps, reappeared on the 
same individual's post-map. They too, howevet, exhibited considerable 
variation from pre to post and especially between individuals in regard 
ta specific content. The gains, determined from counts of number of 
items, appeared to be due to both increased vertical differentiation 
and the addition of new superordinate streams. 

Discussion 

This study failed to establish that concept mapping may be viewed 
as a highly reliable measure. Although there was. moderate constancy on 
two of the three quantitative measures for the concept maps on teaching, 
examination of the Internal content showed considerable variation. By° 

* 

con trasji, the more specific topic, "classroom management", evidenced 
somewljat greater content stability, despite the instructional inter- 
vention and demonstrated increa^ln number of items. 
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We conjecture that, at least for global topics, a concept map pre- 
pared at any one point in time, represented only a portion of the res- 
-pondent*s cognitive content regarding that topic. Repeated efforts, on 
^ later occasions, may be expected to draw on other relevant associations 
with the result that new superordinate concepts appear and prior ones 
are deleted. There is little-^evidencT^o suggest that individuals are 
capable of or sufficiently motivated to represent the full scope of 
their associations to a global area in any single attesQ>t at mapping. 
This is probably especially likely to be the case when there is no 
compelling reason for doing so, e.g., no concern with course evaluation. 
In this study, the decreases in nuzober of streamjffrom pre to post for 
the topic "teaching" may reflect students' 'ladl^#f motivation for doing 
a second concept map on a topic \^ch had not been the focus of instruc- 
tion and, dlnce it had been done before, had little novelty appeal. 

On the other hand, students* gain in number of items appearing on 
"classroom mangement" post-maps suggests that concept mapping does re- 
flect increased knowledge resulting from instructional intervention. 
And, this appeared to be the case even though the students knew that 
the maps would not be used as a grading device by their instructor. 

Study IV 

The questions posed in Study Tn were readdressed in Study IV with 
some methodological variations. 
Subjects ' 

Seven students, including two seniors and five Master's studenj^ 
from an early education methods course were the subjects of this study. 
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Procedure * 

During a class sessipn at the beginning of a unit of study on "Pro- 
viding mislc experiences for young childifen". each student was asked to 
prepared two concept maps—one on the unit topic and the other on a re- 
lated topic. "Provrding art experience for young children." The same 
verbal directions as in prior studies were given and an illustrative 
concept map drawn on the chalkboard by one of the investigators (also 
the course instructor) for the topic. "Careers in Early Education." 
Sheets (12" x 20") were distributed and ample time given for the pre- 
paration of the two maps. The range of time spent was from 20 to 30 
minutes. . • - 

At the end of the unit of instruction, three weeks later, the 
student were agajn asked to prepare concept maps on the same two topics. 
They were told that the maps would be used by the instructor in evaluating 
their learning in thle music area and to further assess their knowledge 
regarding "art." the next topic to be studied. While preparing these 
second set of mkps. they di<i not have access to their first efforts. 
However, upon completion, they were .Invited to compare the two sets and 
six of the" seven students elected to do so. 

Results ' . ' , 

For each of the three types of scores, paired comparisons were made 

1 ' ' ' . 

for the students' pre and post maps. The summary data, including means, 
standard deviations and ranges, are presented in Tabie 4. There was 

Insert Table 3 about here 
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Table 3 

Summary Statistics: Study IV 







Topic: 
Music 




Topic: 
Art 




Pre 




Post 


Pre 


Post 


Number of items 












Means 


31.71 




51.00 


40 14 




S.D. 


19.09 




20.27 


15.25 


10.31 


. Range 


18-73 




23-86 


18-60 


24-47 






3# 77Cp< 


.009) 




90(n.8.) 


Number of levels 








- 




Means 


2.85 




3.71 


3.29 


4.14 


S.D. ; ' 


.69 




1.49 


.49 


1.46 


Range 


2-4 




3-7 




A"" J 


t 




1.87(n. 


8.) 




1.55(n.s 


numoer oi icem 












Streams . 












Means. 


6.42 




2.44 


6.85 


5.71 


S.D. 


6.86 




2.79 


4.06 


3.77 


Range 


2-9 




3-11 


2-12 


2-13 


t 




.48(n.s 


.) 




-.88(n.s 















30 



statistically significant change from pre to post on the "music" maps 
in regard to number of items Ct-3.77, p<.009). There were not signi- 
ficant effects on number of levels or number of streams. The scores for 
number of items, number of levels and ntmber of streams "were found to 
be quite stable for the "art" ^ps. The correlation between pre and post 
scores for number of items for "art" was .76(p <.05) in contrast to 
number of it^is for music (r*.42y n;s.). 

^ Discussion 
Although the number of subjects in each of the four studies in 
this series is small t there is sufficient regularity across studies to 
suggest that the findings are valid. We are now able to address the 
question of whether concept maps have regular features from which re- 
liable measures of differentiation or structural organization may be 
derived. The answer appears to be that there is at least one such 
regular feature — the number of items. In each of the three quantitative 
studies » number of items has been found to discriminate between levels 
of training or instructional intervention.^ This measure of differen- 
tiation has proven to be reliably derived from concept maps'" and to be a 
sensitive change measure. This finding may be an lmporf:ant one. What 
the count of total number of items may be reflecting is the individual's 
repertoire of concepts. This is a line of research in which the first 
author has been simultaneously pursuing (Lay-Dopy era and Dopy era, manu- 
script in preparation). 

The other quantitative measures have been far less consistently 
aligned w4.th educational level or instructional experience. While the 
content of superordinate constructs and the arrangement of levels and 

m 
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streams appear to be very useful as diagnostic devices, our attempts at 
using number of levels or number of streams as quantitative indicators - 
of individual gains from instruction have proven successful in only one 
instance (number of levels in Study II) . ^ 

In the studies ve have conducted to date, ve have not yet adequately 
addressed the issue of whether either the number of items score or the 
qualitative appraisals of concept maps are reflecting competence as 
assessed by other indices. Our attempt to look at this in Study II did 
not seem vell-conceived due to the very general nature of the topic for 
which mapping was done. Further research along this line is needed. 
Also further studies are needed on the extent to which concept maps on 
topics of varying degrees of comprehensiveness remain stable from one 
mapping effort to the next. In conducting these studies, methodology 
will be required to address the motivational problem of respondents re- 
cording only a minimal aspect of what they are able to think of regarding 
an assigned topics There are clearly a number of unanswered questions. 

In sum, however, our work to date reinforces Novak's, claims that 
concept mapping is a viable means for determing what information 
individuals have readily available in memory regarding particular topics. 
We learn what the student can reconstruct from memory without prompts. 
This Icind of testing certainly contributes itore directly and more 
constructively to our understanding of the instructional and learning 
tasks than traditional psychometrics. . 
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